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ABSTRACT 


Strong  laws  of  large  numbers  for  a  sequence  (Xn)  of  random 
functions  in  D[0,1]  are  derived  using  new  pointwise  conditions 
on  the  first  absolute  moments,  which  improve  on  known  results. 

In  particular,  convex  tightness  is  not  implied  by  the  hypotheses 
of  the  theorems.  It  is  shown  that  convex  tightness  is  preserved 
when  random  functions  are  centered,  and  this  result  is  applied 
to  improve  some  known  strong  laws  for  weighted  sums  in  D[0,1). 

A  weak  law  of  large  numbers  is  proved  using  a  new  pointwise  con¬ 
dition  on  the  first  moments  and  some  weak  laws  for  weighted  sums 
are  improved  upon  by  weakening  the  hypotheses.  A  study  is  made 
of  relationships  among  several  conditions  on  (Xn)  which  appear 
as  hypotheses  in  laws  of  large  numbers. 


SI.  Introduction. 


1.1  Laws  of  large  numbers  for  sequences  (Xn)  of  random  functions 
in  D[0,1]  have  been  obtained  using  a  number  of  conditions  on  (Xn) , 
such  as  convex  tightness  and  conditions  on  the  moments  E  ||  Xn  || r  , 
and  others  ( [4] , [13] ,  [14] ,  112]) .  For  random  elements  in  a  Banach 
space  E,  convexity  conditions  on  E  can  be  assumed,  but  such  con¬ 
ditions  are  not  available  in  D[0,1]  which  is  not  locally  convex 
with  the  Skorokhod  topology. 

For  real-valued  random  variables  the  classical  formulations 
of  the  strong  and  weak  laws  of  large  numbers  are  available  and 
satisfactory  formulations  of  necessary  as  well  as  sufficient 
conditions  have  been  obtained  ({5], [8], [7]).  Thus,  the  major 
thrust  centers  around  finding  conditions  which  will  convert  point- 
wise  convergence  (in  some  mode)  into  convergence  in  the  Skorokhod 
metric  or,  which  is  stronger,  uniform  convergence. 

Necessary  and  sufficient  conditions  for  pointwise  convergence 
to  imply  Skorokhod  convergence  are  known  in  terms  of  the  moduli 

•  II 

wx(6)  and  wx(<S)  which  are  used  in  D[0,1]  (the  notation  is  that  of 
[1]).  See  [11],  2.6.1,  p.  277,  for  additional  details.  In  the 
case  of  random  functions  in  D[0,1],  however,  more  useful  conditions 
implying  Skorokhod  convergence  are  desirable,  preferably  in  terms 
of  the  individual  summands.  Various  integral  conditions  have  been 
used  ( [13] , [14] , [12] ) ,  some  of  which  are  listed  in  S3  and  investi¬ 
gated  in  S6. 

1.2  For  a  sequence  <XR)  of  random  variables,  tightness  is  neither 
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necessary  nor  sufficient  for  the  law  of  large  numbers/  strong  or 
weak/  to  hold.  However,  the  concept  of  tightness,  together  with 
conditions  on  the  moments  of  the  random  elements,  has  proved 
natural  and  useful  in  providing  sufficient  conditions  for  laws 
of  large  numbers,  strong  and  weak,  in  Banach  and  Fr€chet  spaces 
([16,] [12]). 

In  D [0 , 1] ,  tightness  has  likewise  played  a  central  role, 
but  hitherto  this  concept  has  taken  the  form  of  convex  tightness, 
in  which  the  compact  sets  involved  are  also  required  to  be  convex 
([13], [4]).  However,  it  was  shown  in  [3]  that  any  compact  convex 
set  in  the  Skorokhod  topology  is  also  compact  and  convex  in  the 
uniform  topology  on  D[0,1].  This  fact  limits  the  scope  of  appli¬ 
cability  of  convex  tightness  as  a  condition  on  a  sequence  (Xn> 
of  random  functions  in  D[0,1],  since  if  (Xn)  is  convex  tight, 
then  all  random  functions  Xn  must  necessarily  take  their  values, 
with  probability  one,  in  a  subspace  of  the  Banach  space  D[0,1], 
which  is  separable  with  respect  to  the  uniform  topology  ([3], SI). 

In  the  classical  strong  law  of  R.  Ranga  Rao  for  identically 
distributed  summands  ([9],  or  [6],  p.  254  ff.)  convex  tightness 
is  not  required.  In  §4.1,  strong  laws  of  large  numbers  for  non- 
identically-distributed  random  functions  which  do  not  require 
convex  tightness  are  obtained,  using  a  condition  generalizing  the 
basic  lemma  used  by  Ranga  Rao  in  the  proof  of  his  result.  In  S4.2 
previous  results  of  [4]  and  [13]  are  strengthened.  In  S5.1  a 
new  weak  law  is  presented,  and  in  S5.2  are  found  some  improvements 
on  weak  laws  in  [13].  Finally,  in  S6  comparisons  of  the  various 
integral  conditions  on  the  random  functions  is  presented. 
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52.  Preliminaries. 


2.1  For  the  definition  of  the  space  D[0,1],  as  well  as  for  the 

definition  and  properties  of  the  Skorokhod  topology,  we  refer  to 

Chapter  3  of  [1].  The  Skorokhod  metric  is  denoted  throughout 

by  d,  and  ||  x||  *  sup  |x(t)l  ,  for  x  c  D[0,1]. 

Ostsl 

2.2  Let  (ft,F,P)  be  a  probability  space  and  make  D[0,1]  into  a 
measurable  space  by  providing  it  with  the  o-algebra  generated 
by  the  Borel  sets  of  the  Skorokhod  topology.  A  measurable  map 
X:  ft  **■  D [0 , 1]  is  called  a  random  element  or  random  function.  In 
particular,  X  is  a  random  function  in  D[0,1]  if  and  only  if  X(t) 
is  a  random  variable  for  each  t  e  [0,1].  The  expectation  EX  of 

a  random  function  X  can  be  defined  pointwise  by  (EX) (t)  =  E{x(t)} 
provided  that  it  turns  out  that  EX  e  D[0,1].  A  sufficient  con¬ 
dition  for  this  is  that  E  ||x||  <  ». 

2.3  In  general,  when  speaking  of  a  partition  P  of  [0,1],  a  finite 
set  of  points  (t^t^  . . . ,  tm)  is  meant  with 

0  =  tQ  <  t1  <...<  tm_1  <  tm  *  1;  or  equivalently,  intervals 
Il,X2,...,In,ll  =  [t^,^),  i«l,...,m-l,  and  Im  -  * 

The  norm  ||p||  of  a  partition  is  the  length  of  the  longest  sub¬ 


interval: 


max  _  {ti+l  "  *1*'  Given  6  >  0,  a  partition 
i«0 , . . .  ,m 


P  is  said  to  be  6 -worse  if 


min  (t.  -  t,  .)  >  6. 
i-l,...,m  1 


2.4  The  Indicator  function  I.  of  a  set  A  eft,  a c  F,  is  defined  by 
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I.(w)  -  0  if  oj  i  A 
A 

and 

I.  ( co )  =  1  if  o>  c  A. 

A 

Also,  "a.s."  stands  for  "almost  surely"  or  "with  probability  one". 


2.5  For  a  given  partition  0  *  tg  <  t^  <...<  t  ■ 
operator  on  D[0,1]  by 


m-1 


m 


x*  l  K( t±)  I,t  t  +  xfl)I{l}* 
i=0  1  lti  ci+l) 


1,  define  the 


If  a  partition  is  not  specified,  then  define  the  operator  T^  by 


2M-1 

.  .  +  x(l)l,  ,. 

i-0  2“  t±=r,  ±±±>  U) 

2m  2m 


T.x  =  l  x(—  )  I  . 

ro  4_a  ri 


The  operator  is  a  projection  of  D[0,1]  onto  a  finite-dimensional 
subspace  which  is  additive  but  not  continuous. 

2.6  By  a  Toeplitz  matrix  we  mean  an  array  (ank)  real  numbers 

satisfying  (i)  lim  a^  =  0  for  each  k=l,2,,..,  and  (ii) 
n-*» 

OP 

\  | ank |  s  1 ,  for  each  n  *  1 , 2 , . . .  . 

k=l 

2.7  Two  lemmas  from  [4]  are  listed. 

LEMMA  2.1:  If  K  is  a  compact  subset  of  D[0,1),  then 

lim  sup  d (x,T  x)  ■  0. 
m~*  xcX  m 

LSMMA  2.2:  If  x,y,u,v  c  Dlo,l],  then 
d(x  +  u,  y  +  v)  S  d(x,y)  +  II  vi  ||  +  ||  v  ||  . 
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S3.  Conditions  on  random  functions  in  D[0,1]. 


Let  (XR)  be  a  sequence  of  random  functions  in  D[0,1].  For 

quick  reference  various  conditions  on  (X  )  are  collected  in  this 

n 

section. 


3.1  (Xn)  is  said  to  be  tight  if,  to  every  e  >  0,  there  is 

K  c  D [0 , 1] ,  compact,  such  that  P [Xn  i  K]  <  e,  for  every  n. 

3.2  (Xr)  is  said  to  be  convex  tight  if,  to  every  e  >  0  there  is 
K  c  d [0 , 1] ,  compact  and  convex,  such  that  P [Xn  i  K]  <  e,  for 
every  n. 

3.3  (Xn)  is  said  to  satisfy  condition  (T)  if,  to  every  e  >  0, 

there  is  K  c  D[0,1],  compact,  such  that  E  ||XnI[X  ^Kj||  <  e,  for 

every  n. 

3.4  (XR)  is  said  to  satisfy  condition  (CT)  if,  to  every  e  >  0, 
there  is  K  c  d[0,1],  compact  and  convex,  such  that 


E  *lXn  I[X  *K]  II  <  e'  for  every  n* 


3.5  (Xn)  is  said  to  satisfy  condition  (MT)  if,  to  every  e  >  0, 
there  is  a  partition  P  of  [0,1]  such  that 


E  [  max  sup  |  X  (t)  - 
i-l,...,m  tel.  n 


VW 1  <  e- 


for  every  n. 


3.6  (Xn)  is  said  to  satisfy  condition  (mT)  if,  to  every  e  >  0, 
there  is  a  partition  P  of  [0,1]  such  that 


I  i 


6 

max  E [  sup  |  X  (t)  -  X  (t .  . ) | ]  <  e, 
i=l,...,m  t€li  n  n  X“A 

for  every  n. 

3.7  (XR)  is  said  to  satisfy  condition  (RR)  if,  to  every  e  >  0, 
there  is  a  partition  P  of  [0,1]  such  that 

max  sup  E|x  (t)  -  X  (t.  . ) |  <  e, 

1  n  n  i-i 

i=l  /  •  •  *  i  in  tc  I  ^ 

for  every  n. 

3.8  (Xn>  is  said  to  be  uniformly  integrable  (UI)  if,  to  every 

e  >  0,  there  is  6  >  0  such  that  E  ||XR  I  II  <  e  for  every 

n 

n,  where  B(6)  =  {x:  ||  x  ||  s  6}. 

3.9  (Xn)  is  said  to  be  stochastically  bounded  (SB)  if,  to  every 

e  >  0,  there  is  6  >  0  such  that  P[  ||Xn||  >  5]  <  e,  for  every  n. 

3.10  (Xn)  is  said  to  satisfy  conditions  (M>r,  r  a:  0,  if  (Xn> 
has  uniformly  bounded  moments,  i.e.,  if  there  is  a  constant  C 
such  that  E  ||xn||r  sc,  for  every  n.  We  abbreviate  (M>r,  r  >  1, 
t°  («)r>1. 

3.11  For  condition  (M)^,  i.e.,  for  uniformly  bounded  first  moments, 
we  write  simply  (M) . 

3.12  For  each  condition  listed  on  (Xn> ,  the  corresponding  con¬ 
dition  for  a  single  random  function  X  in  D(0,1]  is  obtained  by 
taking  (XR)  to  be  identically  distributed. 


i 
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§4 .  Strong  Laws  of  Large  Numbers. 

4.1  The  generalization  of  the  classical  strong  law  to  D[0,1]  is 
the  following  theorem  which  was  proved  by  R.  Ranga  Rao  ([9],  or 
[6],  Chapter  7). 

THEOREM  4.1:  Let  (Xn)  be  a  sequence  of  independent,  identi¬ 
cally  distributed  random  functions  in  D[0,1]  satisfying 

1  n 

E  llX]_ll  <  °°»  Then  lim  ||—  £  X^  -  EX^  l|  =  0,  with  probability  one. 

k= 1 

THEOREM  4.2:  Let  (X^)  be  a  sequence  of  independent  random 

00  -r  r 

functions  in  D[0,1]  satisfying  condition  (mT)  and  £  k  E  ||x,||  <  « 

k=l  k 

for  some  r,  1  £  r  s  2.  Then 

l  n 

lim  ||  i  l  (X.  -  EX.  )  ||  “0,  with  probability  one. 

n-*«  k=l  K  k 


PROOF:  An  easy  calculation  shows  that 


max  E[sup  |Xn(t)  -  EXn(t) 


s  2  max  E[sup  |Xn(t)  -  X  (tj^)  |  ] 
i  tcl^ 


and  hence  the  sequence  (Xn)  can,  without  loss  of  generality,  be 
assumed  to  satisfy  EXn  =>  0,  for  each  n. 

Let  e  >  0  be  given  and  choose  a  partition  P  of  [0,1]  such  that 


sup  max  E [sup  |X  (t)  -  X  (t,  ., )  |  ]  s  e.  (1) 
n  i-l,...,m  t€l.  n  n  1-1 


Mrite  11  »  Ji  x>'11  s  11  hJi1xh  -  Vk>  II  -  II  H  JiVk'l  - 

where  T  is  defined  in  §2.5.  Mow 
in 

,  n  ,  n 

lim  ||  i  I  T  X  ||  =  lim  max  |±  £  X(t.)|  =  0, 

n  n  k»l  m  K  n  i=0,...,m-l  n  k*l  x 


a.s.,  by  Chung's  strong  law  of  large  numbers. 


Next,  II  (**  *  Vkl  II 


\  11 

=  max  sup  |-  l  (X.(t)  -xk<t._1))| 

i*l,...,m  tcl^  k=l 

l  n 

s  max  -  l  sup  |X  (t)  - 
i*l, . . .  ,m  n  k=l  te^ 


1  r  i 

*  max  -  I  Y.  ,  where 
i*l, . . . ,m  n  k=l  K 


Y*  *  sup  |xk(t)  -  Xfc ( ti_i> | ,  i  =  l,...,m;  k  ■  1,2,...  . 
t€li 

Now  for  each  i,  (Yk  -  E ( Y^) )  is  a  sequence  of  independent  random 
variables  with  zero  means  and  E|Yk  -  E(Yk>  |r  £  4rE  ||xk||r  • 

Thus,  the  strong  law  of  large  numbers  yields,  for  each 

x  ®  !/•••/ m f 


lim  i  l  <Y*  -  EY*)  -  0, 
n  k*l 

-  .  n 

Hence,  lim  ||±  l  (X.  -  T  X  )  || 
n  n  k*l  K  m  K 


a.s. 


n»x  i|«!-  *  ...  “*  _  5  j, 

_  _  n  i*i, . . .  ,m  k*i 

n  i*i , . . . ,m  x* i 
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s  0  +  lim  i  l  E[  sup  |X.  (t)  -  X.(t.  .)|] 
n  n  k-1  t«Ii  K  K  1-1 

s  e  by  (1) ,  a. s. 

The  proof  is  completed  by  letting  e  0  and  excluding  a 
countable  union  of  null  sets.  Q.E.D. 


REMARK:  The  conditions  of  Theorem  4.2,  in  the  case  l<rs2, 
do  not  imply  that  (Xr)  is  tight.  If  r  ■  1,  then  tightness  is 
implied. 


THEOREM  4.3.  Let  (X^)  be  a  sequence  of  independent  random 
functions  in  D[0,1]  satisfying  condition  (RR)  and  the  following 
condition: 

To  every  e  >  0,  there  is  a  compact  set  K  c  D[0,1]  such  that 


1°.  E  || Xn  lfx  ||  <  e,  for  every  n, 

n 

2*.  I  n‘r  E(|||XnI(x  ,K,||  -  E  ||Xn  I[x  ,K]||  |)r  < 


for  some  lsr£2. 

n 


Then  lim 
n-+-°° 


i  T  (Xt  -  EX.  ) 


”  k;i •  k 


0f  with  probability  one. 


PROOF:  Note  that  1  implies  that  E 


n 1 


<  *  ,  which  in  turn 


implies  that  EXn  exists  for  each  n.  Let  e  >  0  be  given  and  let  K 
be  a  compact  set  such  that  both  1*  and  2°  hold.  Put  ■  X^  I  jx  eKj 

n  k 


and  X. 


Xk  I[Xk^K]* 
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Since  K  is  compact  there  is  6  >  0  such  that,  for  any  x  e  K, 


|x(t)  -  x(s)|  s  | x(u-0)  -  x (s)  |  +  e, 


whenever  0ssst<u<s+«.  (See  [6],  proof  of  Theorem  8.1, 


p.  257). 


By  (RR)  choose  a  partition  P  such  that 


sup  max  sup  E | X  ( t)  -  X  (t.  ,)|  <  e,  (2) 
n  i«l,...,m  tdi  n  n  1-1 


and,  by  adding  points  if  necessary,  arrange  for 


||P||  <  6. 


Write 


1  -Exk<t»i+ll  +  sl  “Kn 


Using  (1)  and  (3)  we  have,  for  t^st  <  t^,  i  =  l,...,m, 


n  -<(«)!  *  In  "  Exll<ti-l))l 

+  ui,  '»  Ji<x*(t)  ' 

+  sup  |i  l  (ex' (t)  -  ex' (t.  .)) I 
teli  n  k»l  K  K  1-1 

♦  hJ^VV0’  -  xk<ti-l)  I  +  « 

+  £  I  lEx'ttj-O)  -  Ex'(ti_1)|  +  e. 

k  ®  1 


5 


+  e. 


j 
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By  the  Strong  Law  of  Large  Numbers, 

1  2  *  * 

lim  -  l  (X.  ( t . )  -  EX.(t.))  =0  a.s.  (6) 

n-*~  n  k=l  K  1  K  1 

for  each  1  «  0,1,..., m. 

By  (2),  nax  ;  J  |Ex'(t.-0)  -  Ex' (t.  .)| 
i-l,...,m  k=l  K  1  1“1 

1  ^  |  f 

£  max  i  l  E|X  (t.-O)  -  X.(t.  .)|  <  e.  (7) 

i=l, . . . ,m  n  k=l  K  1  K 

1  H  |  I 

for  every  n.  Now  -  £  lXk(ti“0)  -  X^t^)  | 

X 

'  n  Ji,|xk‘V0>  *  xk(tl-l>l  -  BK<V°>  -  VVl’H  *E- 

using  (7)  and  thus,  since  the  random  variables  are  bounded,  by 
the  Strong  Law  of  Large  Numbers, 

~  i  n  i 

lim  ~  l  |x.(t.-0)-  Xv(t.  ,)|  <  e,  a.s.  (8) 

n~*  n  k«l  *  1  K  1-1 

for  each  i  *  l,...,m. 

From  (6) ,  (7) ,  (8)  and  (5) ,  we  get 

lim  H  i  l  (X*  -  Ex')  ||  -  0,  a.s.  (9) 

n-**»  n  k«l  *  * 

Now  lim  i  l  (  ||XJ|  -  E  ||x"||  )  <  2e,  a.s.  (10) 

n-*~  n  k»l  *  K 

by  the  Strong  Law  of  Large  Numbers,  using  hypothesis  2°.  Using 
(10)  and  hypothesis  1°  we  then  have 
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lim  n  Z  <11  x"  ||  +  E  ||x"  ||) 
n-*-»  k»l  * 

-  Xi®  H  Z  < II  Xkll  -  E  Hill  >  +  I  ?  E  11**11 

n-*-00  n  k=l  K  K  n  k=1  * 

<  2c,  a.s.  (11) 

Using  (11)  and  (9)  we  get,  via  (4) , 

-  .  n 

lim  ||  i  l  (X.  -  EX.  )  ||  <  4e,  a.s. 

n-M»  n  k=l  K  K 

Taking  a  sequence  (en)  of  positive  numbers  converging  to  0,  we 
get,  taking  a  union  of  null  sets, 

1  n 

lim  ||  -  l  (X.  -  EX.  )  ||  *  0,  a.s.  Q.E.D. 

n-x*  n  k=»l  K 

REMARK:  Condition  2°  is  somewhat  complicated,  but  it  would 

seem  to  render  Theorem  4.3  independent  of  Theorem  4.2.  By  itself, 

1°  is  of  course  condition  (T) ,  and  (T)  together  with  (RR)  implies 

(mT)  (§6,  Lemma  6.11).  Thus,  if  2°  is  replaced  by,  say, 

00 

l  n  r  E  1 1 X  I  ,v  >v1||r  <  this,  for  l<rs2,  would  imply 
n=l  n  lXn*KJ 

°°  _r  r 

l  n  E  1 1 X  ||  <  »  and  the  hypotheses  of  Theorem  4.3  would  imply 

n=l  n 

those  of  Theorem  4.2.  If  r  =  1,  Theorem  4.3  may  still  be  independent 

«  » 

of  Theorem  4.2  if  2°  is  replaced  by  T  n”  E  ||x  I  rv  ||  <  •» 

n-1  n  IXn^K] 

(here  1°  follows  and  need  not  be  stated). 

COROLLARY  4.4:  Let  (XR)  be  a  sequence  of  independent  random 
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functions  in  D[0,1J  satisfying  (RR)  and  such  that  there  is  a 

compact  set  K  with  P[X  «K]  »  1,  for  every  n.  Then 
1  n  n 

lim  ||  -  T  (X.  -  EX.)  ||  0 ,  with  probability  one. 

n  k=l  *  K 

REMARK:  Note  that  the  convex  hull  of  K  need  not  be  condi¬ 
tionally  compact.  In  fact,  it  is  shown  in  16.4  that  (RR)  does 
not  imply  convex  tightness. 

4.2  Denote  the  topology  on  D[0,1]  generated  by  the  Skorokhod  metric  by 

T  and  that  generated  by  the  metric  given  by  the  suprorun  norm 
s 

II  x  ll  =  sip  |x(t)  |  by  T  .  When  D[0,1]  is  provided  with  the  siprenun  norm, 
Oitsl  u 

it  is  a  Banach  space. 

Denote  by  K  the  collection  of  all  subsets  K  of  D[0,1]  which  have  the 

property  that  their  convex  hulls  co  (K)  are  conditionally  ocnpact  re  T  . 

s 

We  shall  need  the  following  result  from  [3]. 

THEOREM  4.5:  If  X  e  D[fl,l]  then  K  e  JC  if  and  only  if  K  is 
conditionally  compact  in  Tu. 

LEMMA  4.6:  Let  (Xfi)  be  a  sequence  of  convex  tight  random 

functions  in  D[0,1].  If  E  ||xnJ|rs  C  <  ®  for  all  n,  and  some  r  >  1, 

then  the  sequence  (X„  -  y  ) ,  where  y^  ■  EX^,  is  convex  tight. 

n  n  n  n 

PROOF:  To  every  m  <  N  there  is  a  (Skorokhod)  compact,  convex 

1  r 

-  trjT  -  r  zr 

set  K  such  that  P[X  rflLl  <  C  m  ,  for  every  n.  By 

m  n  m 

Theorem  4.5,  Km  is  compact  re  7U.  Hence,  co  is  compact  re  Tu, 
and  we  assume  without  loss  of  generality  that  Km  is  convex  (and 
compact)  re  Tu,  and  also  that  0  t  Km< 
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Since  D[0,1]  with  the  supremum  norm  is  a  complete  metric 
space,  is  totally  bounded  (no  separability  is  needed  here) . 
Let  N(x,e)  ■  {y:  ||  x-y  ||  <s),  x  e  D[0,1],  e  >  0. 

1  iw 

Let  (N(x.,  —  )}  be  a  finite  cover  of  K_. 

1  m  i.i  m 

NOW,  II  »n  -  EXn  I  ,11  *  e  II  xn  I,x  ,K  )H 


s  <E  llEn||r)r(E  I(J[  <K  j)  r  <  i  ,  for  every  n. 

Since  K  is  convex  and  0  e  K  ,  E[X  I fv  „  ,]  e  K  ,  for  every  n, 
m  m  n  ix_ck  i  m 

n  m  ^ 

and  hence  d(y  ,  K  )  <  for  all  n.  Write  «  u  N(x. ). 

n  m  m  i*l  i  m 


By  the  triangle  inequality  e  Kl  '  for  every  n.  Since  this 
holds  for  every  m, 

00 

y  €  K  =  n  K*m^,  for  every  n. 
n  0  m=l 

Since  KQ  is  obviously  totally  bounded,  it  is  conditionally  compact 
re  Tu  .  The  closed  convex  hull  K  **  co  (KQ)  is  compact  re  Tu  , 
and  consequently  conditionally  compact  also  re  T  . 

Now  let  e  >  0  be  given  and  choose  Ke ,  compact  and  convex  re 

T  ,  such  that  P[X  «  K  1  >  1  -  e,  for  all  n.  Then 

s  n  t>  « 

P[Xn  -  un  €  Ke  -  K)  a  P(Xn  €  Ke  and  wn  e  K]  -  P [Xn  «  K£]  >  1  -  e, 
for  all  n.  Since  K  «  K  and  KcK,  K-KeK  by  Theorem  9.8  of 


[2],  Thus  (X„  -  u  )  is  convex  tight, 
n  n 


Q  •  E*  •  D . 


It  f ollow8  from  Lemma  4.6  that  the  conclusion  of  Theorem  1 


(*)  See  also  [6],  Lemma  3.1,  p.  29. 


of  [4]  can  be  strengthened  to  almost  sure  uniform  convergence. 
We  now  state  this  result  in  its  strengthened  form. 


THEOREM  4.7:  if  (X^)  is  a  sequence  of  independent  convex 

tight  random  functions  in  D[0,1]  satisfying  sup  E  ||x  ||r  <  °», 

,  n  n  n 

with  r  >  1,  then  lim  ||  —  £  (X.  -  EX.  )  ||  =0,  with  probability  one 

n-*»  n  k=l  K  K 

This  result,  however,  is  implied  by  Theorem  4  of  [13],  for 
which  we  now  provide  an  alternate  proof.  Two  preliminary  results 
are  needed. 


LEMMA  4.8  ([12],  p.  123):  Let  (Xn)  be  a  sequence  of  real¬ 
valued  random  variables  such  that  sup  e|x  |r  <  »,  for  some  r  >  1. 

n  n 

Then  there  exists  a  random  variable  X  such  that 


(i)  P [ I X  |  *  a]  £  P  [  I X |  2  a],  for  all  n  and  a  2  0; 

n 

1 

(ii)  E{ | X | 1+8 }  <  ®  for  0  <  ^  <  r  -  1. 

s 

The  following  theorem  is  due  to  Rohatgi  [10]. 


THEOREM  4.9  ([12],  p.  68):  Let  (X  )  be  a  sequence  of  (real- 

n 


valued)  random  variables,  with  EX 


n 


for  every  n,  and  let  (*nJc) 
-s, 


be  a  Toeplitz  sequence.  If  max|anJJ  «  0(nj  for  some  s  >  0, 


and  there  is  a  random  variable  X  satisfying 


(i)  P [ I X  I  2  a]  s  P [ I X I  2  a]  for  all  n  and  a  2  0;  and 

n 

1 

(ii)  E|X|1+S  <  •; 

then 

00 

lim  l  a  .  X.  ■  0,  with  probability  one. 
n-*»  k-1  nK  * 


■  -str.  .»***«-  ■*  -* 


THEOflEM  4.10;  Let  (Xn)  be  a  sequence  of  independent  random 
functions  in  D[0,1]  satisfying  the  following  condition; 


(CT)  . ;  To  every  e  >  0  there  is  K,  compact  and 


convex,  such  that  E  ||XnIjx  ^Kj||r<  E • 
for  every  n,  where  r  >  1. 


Let  {a  .}  be  an  array  of  weights  satisfying  the  additional 


condition  that  max 


k=l, . . . ,n 


«e  1 

OK n  ) ,  where  0  <  —  <  r  -  1. 


Then 


n  n 

lim  d(  \  a  .X.  ,  \  a  ,EXV)  *  0,  with  probability  one. 

n-*»  k=l  nK  K  k»l  nK 


PROOF;  Let  e  >  0  be  given  and  select  K,  compact  and  convex 


by  (CT)r>1  such  that 


S  II xn  IIX  ^K]Hr<  e'  for  every  n* 


Note  that  this  implies  the  existence  of  EXn,  for  each  n.  Without 

loss  of  generality  K  can  be  taken  to  be  balanced  and  symmetric 

(write  K.  =  u  a  K  and  replace  K  by  K.  -  K. ;  cf  [2],  Theorem  9.8,  p.28) ; 
A  |a|*l  1  1 

this  in  turn  implies  that  K  is  absolutely  convex.  This  we  assume. 

f  H 

Write  *  Xk  I  €Kj  ,  xk  28  xk  1  [x  *KJ  *  **®  *****'  Lawna  2.2: 

k  k 

d(Jl  ankxk '  a„kExk>  1  d(jl  an kxk '  Jx  a„k  Vxk>> 

+  d<Jl  a"k  T»lX*’'  Jl  ‘‘"k  VExk>> 


17 


♦  d<  Jx  ank  VEXk>  '  j,  a„k  EXk> 


(2) 


+  H  J1  *nk  <11  ♦  II  Jx  *nk 


*  (I)  +  (II)  +  (HI)  +  (IV)  +  (V)  . 


r 

Now  l  a  .X.  c  K,  for  all  n,  since  K  is  absolutely  convex.  Thus, 
k=l  nK  K 
using  Lemma  2.2, 


large  m. 
Now 


(I)  s  sup  d(x,  T  (x))  <  e,  for  all  sufficiently 
xcK  m 


(XI)  S  ||  T  I  a„k(x;  -  EX^)  || 
k=l 


(3) 


,  „  “* »  IJ  tw  -  "VV 

1=0 , . . . , 2  -1  k=l 


using  d(x,y)  <;  ||  x  -  y||  and  the  additivity  of  T^.  Since  K  is 

I  • 

compact,  the  random  variables  Xk(t^)  -  EX^(t^)  are  uniformly 
bounded  and  so  an  application  of  Theorem  3.6  yields 

n 

lim  l  a  .  (X  (t.)  -  EX.  (t. ) ) 
n-*-®  k=l  nK  K  1  K  1 


Hence 


lim  max 

n-*»  i*0 , 1, . . . ,  2  -1 


a.s. 


Since  K  is  convex,  EXk  c  K,  for  all  k,  and  so,  just  as  for  (I), 

n  .  n 

(III)  =  d(Tm(  l  EXr),  l  EXr)  s  sup  dU'Tj)  <  e,  (5) 
k-1  k»l  XcK 


for  all  sufficiently  large  m. 


=  0,  a.s.,  for  each  i  =  0,1, . . . ,2m-l. 

Jx  ank(xk(ti>  -  Exk(tl”  *  °> 

(4) 


IS 


Now  (IV)  +  (V)  s  l  |anjc|  (||  x"  ||  -  E  ||x"  ||) 

lc®  X 

+  2  l  E  ||  x”  ||  .  (6) 

k=l  K 

Since  E  |  ||X^  ||  -  E  ||x"||  | r  s  2rE  ||x"  ||r  s  2r  e  <  «, 

for  every  k,  where  r  >  1,  by  Lemma  4.8  there  is  a  random  variable 

X  such  that  (i)  P[|x|  2  a]  s  P [ | X |  2  a],  all  n,  all  a  2  0;  and 

.1  n  1 

(ii)  E | X | ^  s  <  »/  where  0  <  —  <  r  -  1.  Since  »ax|a  .  |  «  0(n~3), 

s  k  nK 

Theorem  4.9  yields 

00 

lim  J  lankl  (H  Xk  II  -  E  IIXJI  >  -  0,  a.s.  (7) 
n-°°  k=l  nK  K  K 

From  (1)  we  have 

OO  M 

2  l  |ank|  E  ||Xk|[  s  2e .  (8) 

k  ~  1 

Using  (3),  (4),  (5) ,  (6),  (7)  and  (8)  in  (2),  we  get 

n  n 

lim  d (  l  a  .x.  ,  l  a  .  EX.  )  <  e  +  e  +  2e  »  4e,  a.s. 
n-*>«  k»l  K  k=l  nK  K 

Taking  a  sequence  (en)  of  positive  numbers  converging  to  zero 
and  taking  a  union  of  null  sets,  we  get  finally 
n  n 

lim  d(  l  a  .X.  ,  l  a  .  EX.  )  *  0,  with  probability  one, 
n-*»  k-1  n  K  k=l  nK  * 

Q .  E .  D . 

That  Theorem  4.10  is  equivalent  to  Theorem  4  of  [13]  is  seen 
as  follows.  On  the  one  hand,  (CT)„>?  implies  both  (CT)  and 
(M)r>1,  and  (CT)  implies  convex  tightness  (Lemma  6.8).  On  the 
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other  hand,  convex  tightness  and  (M)r>^,  imply  (CT)r>^.  Indeed, 

« 

let  1  <  r  <  r.  We  have 

r  r 1  r-r ' 

E  ||X  Hr'  1  ,  £  tE(  ||Xn||r‘) r ']  r  [P  IX  *K]]  r 

n 

r 1  r-r' 

*  (E  ||Xn||r  )r  {P[Xn<K]l  r  . 

Now  E  llxn||r  are  uniformly  bounded  by  and  P[Xn^K]  can  be 

made  uniformly  arbitrarily  small  by  convex  tightness  and  the 
choice  of  K.  Thus,  to  any  e  >  0  there  is  K,  compact  and  convex, 

v  I 

such  that  E  ||Xn  I  ^  |j  <  e  for  all  n,  which  is  condition 

(CT) r » >i •  Q.E.D. 

Although  the  conclusion  of  Theorem  4.10  is  stated  in  terms 
of  convergence  in  the  Skorokhod  metric,  this  can  be  strengthened 
to  uniform  convergence  by  an  application  of  Lemma  4.6. 

§5.  Weak  Laws  of  Large  Numbers. 

5.1  Weak  laws  of  large  numbers  for  random  elements  in  function 
spaces  (or  more  general  Banach  or  Fr^chet  spaces)  come  in  two 
types.  First,  there  are  those  based  on  sufficient  conditions 
(usually  some  type  of  weak  uncorrelation)  which  imply  the  con¬ 
vergence  in  probability  of  the  weighted  sums.  Second,  there  are 
those  which  provide  conditions  sufficient  to  turn  pointwise 
convergence  in  probability  into  convergence  in  probability  in  the 
metric  of  the  function  space;  whereupon  necessary  and  sufficient 
conditions  for  the  classical  weak  laws  can  be  invoked  to  provide 
the  pointwise  convergence.  In  this  section  we  present  one  result 
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of  the  first  type,  and  three  of  the  second  type  which  improve  on 
existing  results  (for  existing  results  see  [12],  [15]). 

5.2  The  following  theorem  uses  a  condition  on  second  moments 

and  an  uncorrelation  condition  which  looks  rather  like  the  condition 

(MT)  which  was  used  to  obtain  strong  laws  in  the  previous  section. 

DEFINITION:  A  sequence  (X^)  of  random  functions  in  D[0,1] 
is  said  to  be  pointwise  uncorrelated  if 

Cov(Xk(t),  X£(t))  =  E[(Xk(t)  -  EXk(t))(X£(t)  -  EXA(t))]  *  0 

for  each  te[0,l]  when  k  ^  l. 

THEOREM  5.1:  Let  (Xn)  be  a  sequence  of  mean  zero,  pointwise 
uncorrelated  random  functions  in  D[0,1]  satisfying 

l8.  lim  — |  l  E  || X  I) 2  =  0; 
n-*-”  n  k=l  n 

2  .  To  every  e  >  0  there  is  a  partition  P  of  [0,1] 
such  that 

sup  E  [  max  sup  |xk(t)X£(t)  -  xk  ( t^)  ( t^)  I  ]  5  e* 

k,8.  i«l, . . .  ,m  tel^ 

1  n 

Then  lim  ||  —  £  X,  ||  =  0,  in  probability. 

n-*'°°  n  k=>l  * 

PROOF:  Let  e  >  0  be  given,  and  choose,  by  2°,  a  partition  P 
such  that 

_  3 

sup  E[  max  sup  |xk(t)X£(t)  -  xk ( t±_1> X £ (t±_1) | ]  s  |  . 
k,  i  i«*l, . . .  ,m  tdi 
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Then  PC  |1  I  Xk  j|  *  ne]  s  E  II  Z  ^  |j 
k=l  n  c  k3*  X 


n 


=  T7eI  sup  |  l  X.  Ct)  | 2] 
n  e  Ostil  k=l  * 


=  -|^E[sup  (  £  (X.  (t)x  (t) 

n  e  0*tsl  k,4=l  *  x 


n 


-  Wi'Wi1*  +  k  ^  Wi’^Vi” 


1  n 

s -y-^EC  max  sup  £  (xk(t)xi,(t)  “  Xk(ti-l)Xil(ti-l)  ] 


n  e 


i  tel^  k,4=l 


+  -bEI"“  J.  WAiti-i" 

n  s  i  k  r  x*— x 


(*) 


For  the  second  term  in  (*) 

n 


T7E[mx  t  L  Vti-l>xt(ti-l,J 

nc  x  i 


•»  m  n 

X  X  E|„  ?  ,  V'WV'W1 


ne  i=l  k , £=1 
m  n 


-  ~T2  l  l  E(xk(ti-i)2^  "TT  ^  E||xkl 

n^e^  i=l  k-1  K  1  1  n^e2  k=l  K 


which  can  be  made  less  than  %  for  all  nan.  from  1°.  For  the 

4  0 

first  term  in  (*) 


l  n 

Elmax  sup  £  (XR  (t)  X£  ( t)  “  xjc ( i  >  X£  ( ti_1 ) )  ^ 


n  e 


i  tel^  k,£=l 


l  n 

s  -y^E[max  sup  £  (Xk  (t)  (t)  -  Xk  (t^)  X^  ( t±_1) )  ] 


ne"  i  t«  1 4  k  ,  4 
1  k  jit 
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+  — *r  2  E  [max  sup  l  (X^(t)  -  X^(ti_1))] 


n  e 


i  tel.  k*l 

i 


5  ~T1~  SUP  EImax  sup  l x.  ( t) xA (t)  -  xk(t._1)x£(ti_1) )  ] 
n  e  k,A  i  teIA 


n 


+  ^  Ji  E  l|x*11 


e  4.  2e  _  3e 
4  4  “  4 


for  all  nan.  Hence,  for  nan. 

o  o 


n 


P[  ||  l  x  ||  a  ne]  <  ^|  +  f  *  e. 
k=l  K 


Q.E.D. 


5.2  The  next  result  provides  sufficient  conditions  for  the 
equivalence  of  pointwise  and  uniform  convergence  in  probability, 
and  improves  on  Theorem  1  of  [13]. 


THEOREM  5.2:  Let  (Xn)  be  a  sequence  of  random  functions  in 


D  [0 , 1]  having  property  (MT)  and  such  that  E  ||x  ||<»,  for  each  n. 

00 


Let  (ank)  be  a  double  array  of  real  numbers  satisfying  £  |ank|sl, 

n  k=  1 


for  each  n.  Then  lim  £  «nk(Xk(t)  -  EX^Ct))  =  0,  in  probability. 


n-*-°°  k=l 

for  each  t  c  [0,1],  if  and  only  if 

n 


lim  ||  l  a  .  (X.  -  EX.  )  ||  *  0,  in  probability. 

n-*»  k=l  nK  K  K 


PROOF:  Since  (X  )  has  property  (MT) ,  so  does  (X  -  EX  )  ( [14 ] , 
n  n  n 


proof  of  Theorem  1).  Thus  w.l.o.g.,  we  assume  EXn  »  0,  for  every  n. 


Let  t)  >  0  and  e  >  0  be  given  and  choose,  by  (MT) ,  a  partition 


P  such  that 


sup  E[  max  sup  |Xk(t)  -  Xk(t^_^)|]  s  ~  . 


n  l-l, . . . ,m  t c  X  ^ 


Then 


p[  "Ji  “"A11  ” El 


P[  11  Jj.  ank<xk  -  TmV  'I  »  f>  +  P[ll  Ji  ank  VkH  >  f  ] 


Pl  11  Jl  “nk^k  ‘  Vk'H  'I1 


*  I  E  H ^  a„k<xk  -  Vk> 


*  t  Jl  l*nkl  £H  Xk  *  V. 


"1,1,  lankl  Et.  ,  _  auf  lXk(t)  -Xk<ti-l)l’ 


f  •  •  •  § n\ 


^  2  r  |  nt  n 

5  e  l.  |ank'  T  5  I 

k=l 


P'H  Jj  ank  Vkll  "I1 


PI. _,max  „  ank  Xk(ti>  I  >  I1  <  2  - 

i-l ,  •  •  •  fin  k®  1 


for  all  sufficiently  large  n. 


si 

Thus,  to  every  e  >  0  and  t\  >  0,  P[||  l  a  .  X.  ||  >  e]  <  n, 

k-1  nK  K 


fox  all  sufficiently  large  n. 


Q  •  E  •  D  • 
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Theorem  3  of  [4],  strengthened  to  yield  uniform  convergence, 
will  now  be  obtained  as  a  corollary. 


COROLLARY  5.3:  Let  (X  )  be  a  sequence  of  convex  tight  random 

l  5 

functions  in  D  satisfying  (M)  ...  Then  lim  —  £  [X.  (t)  -  EX.  (t)  ]  =  0, 

r  x  n-~°  n  k=l  K  K 


in  probability,  for  each  te[0,l),  if  and  only  if 


1  *» 

lim  ||  —  l  (X.  -  EX.  )  ||  *  0,  in  probability. 
n-*»  k=l  K 


PROOF:  We  have  (M)r>1  =*  (UI)  and  convex  tightness  and 
(UI)  =*>  (MT)  (§6,  Theorem  6.7),  and  ank  =  i,  k«l,...,n;  ank  *  0, 
k  >  n,  satisfies  the  condition  of  Theorem  5.2.  Q.E.D. 


COROLLARY  5.4:  Let  (Xn)  be  a  sequence  of  random  functions 
in  D [0 , 1]  having  property  (MT)  and  such  that  E  ||Xn||  <  “,  for  each  n. 


1°  cov(Xk(t),  X ^ ( t) )  =  0  for  each  k  ?  Si,  for  each  t  «  [0,1); 

and 

o  n  2 

2  l  var(X.  (t))  =  o(n  )  ,  for  each  t  e  [0,1], 
k=l  K 

then, 

1  n 

lim  ||  i  l  (X.  -  EX.  )  |j  =  0,  in  probability. 
n->®  n  k=l  K  K 


§6 .  A  Comparison  of  Various  Conditions  on  Random  Functions  inD[0,l]. 

6.1  In  this  section  we  investigate  relationships  among  the  con¬ 
ditions  on  a  sequence  (Xn)  of  random  functions  in  D[0,1],  which 
were  defined  and  collected  together  in  13.  The  most  striking  result 


is  Theorem  6.7,  which  asserts  the  equivalence  of  convex  tightness, 
(CT)  and  (MT)  for  uniformly  integrable  sequences.  Also,  (CT)  is 
shown  to  imply  convex  tightness;  (CT)  also  implies  (MT)  but  uniform 
integrability  (UI)  appears  necessary  for  the  converse.  Examples 
are  given  to  show  that  many  implications  cannot  be  reversed; 
however,  some  open  questions  remain. 

6.2  LEMMA  6.1:  If  (Xn)  satisfies  (T)  then  (Xn)  is  stochastically 
bounded . 

PROOF:  Let  e  >  0  be  given  and  let  K  be  compact  such  that 

E  ||x  I,  ,Ki  ll  <  e*  for  each  n.  Let  c  *  sup  ||x||  and  let 
1  n*  1  xcK 

6  >  max{2,2c).  Then 

P[  ||Xn  ||  >  6]  s  P[  ||Xn  I[x  eK]|l  >  6/2]  +  P[  ||Xn  I  ^K]||  >  6/2] 

n  n 

=  °  +  P[  ||Xn  1  jX  ,K]  II  >  «/2) 
n 

SfE||XnI|Xn«]H  ‘f'-"  '  Q-E-D- 

LEMMA  6.2:  (CT)  implies  (MT) . 

PROOF:  Let  e  >  0  be  given.  By  (CT)  choose  K,  compact  and 

convex,  such  that  E  ||Xn  I  jx  ^Kj  II  <  jr  for  every  n. 

n 

Since  K  is  compact  and  convex  there  is  a  partition  P  of 
(0,1]  and  6  >  0,  using  Theorem  3.6  of  (3],  such  that 
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sup  max  sup [ x (s)  -  x(t) I  <  f  •  (*) 

x«K  i*»l,...,m  t,sel^  2 


Then  E[  max  sup  |x  (t)  -  X  (t.  . ) I ] 

i-1, . . .  ,m  tel.  n  n  i-l 


‘  "i-l  ESiIX»‘t>  -Xn(ti-l>|l[Xn«K1> 

*  E(f)  +  E[2||Xn  I,x  <K]||  1  (using  (*)) 


n 


.  e  .  e  „  , 

<  2  +  2  m  £/  f°r  ev®*Y  n. 


Q.E.D. 


LEMMA  6.3:  Let  (X^)  be  a  sequence  of  random  functions  in 
D[0,1].  If  (Xn)  satisfies  (MT)  and  is  stochastically  bounded, 
then  (Xn)  is  convex  tight. 

PROOF:  Given  e  >  0,  find  by  (MT)  a  partition  P  such  that 

sup  E(max  sup  | X  ( t)  -  X(t.)|)  s  e. 

n  1  Vfc<ti+1 

This  implies  that 

sup  P (max  sup  |X  (t)  -  X  (t.)|  > a]  <  -  ,  (*) 

n  i  tiststi+1  n  n  1  a 

for  any  a  >  0. 

Let  and  be  se(Juenc«*  of  positive  numbers  such  that 

ao 

lim  rv  •  0  and  l  e.  -  c. 

k-1  K 
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nm-****- 


Let  6^  be  chosen  by  stochastic  boundedness  so  that 


sup  Pt  ||  Xn  ||  *  <5V]  £  ev. 


n 


Let  B  (6)  ■  {x  t  D [0 , 1]  :  |jx||  26}  and  define  the  sets 


At(e)  =  {x  e  B (6.  )  :  max  sup  |x(t)  -  x(t.)|  s  n.J 


1  V^i+i 


where  the  partition  Pk  which  is  used  is  chosen  so  that 


sup  E  [max  sup  |Xn(t)  -  X^t^)]  *  nk  ek» 


n 


1  ti^t<ti+1 


which  is  possible  by  (MT) . 

Then,  using  (*)  ,  we  have 


sup  P[Xn  i  Ak(e) ]  <  ek. 
n 


r** 


Now  put  A(e)  =  n  A.  (e).  Let  n  >  0  be  given  and  find  kn, 
x  k  K  0 

such  that  ~  n. 

K0  1 


For  x  c  A(e)  we  have, 


max  sup  | x ( t )  -  x(t.)|  s  nv  <  \  n, 

•  x.  yi.y  a.  *  Q  ■ 


x  t.St<t.+1 


because  x  e  A.  (e) .  It  follows  that 
K0 


max  sup  jx(t)  -  x(t-0) |  <  n»  and  so 
1  ti<t<ti+l 


S(A(e))  ■  {t  «  [0,1] :  sup  |x(t)  -  x(t-0) |  >  n)  is  finite 

n  xcA(e) 
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mt+i.**'-- 


(at  most  m.  ,  the  number  of  points  of  the  partition  P)  for  each 
K0 

n  >  0. 

If  the  set  A(e)  is  conditionally  compact,  it  will  follow  by 
Theorem  6  of  [4]  that  the  convex  hull  co(A(£>)  is  conditionally 
compact . 

To  prove  that  A(e)  is  conditionally  compact,  we  use  Theorem 
14.3  of  [1].  The  set  A(e)  is  bounded  since  x  e  A(e)  implies 
||  x  ||  s  How  let  a  >  o  be  given  and  let  k  be  such  that 

Then  there  is  a  partition  P,  by  definition  of  A^U)  , 
such  that  for  each  x  e  Ak(e)  (a  fortiori  each  x  e  A(e)),  we  have 

max  sup  |x(t)  -  x(s)|<  a. 


I 

If  6  =  min{t.  .  -  t.}  for  P,  then  sup  w  (6)  <  a,  and  since 
i  1+1  1  xeA(c)  x 

• 

o  >  0  is  arbitrary,  lim  sup  w  (5)  =  0,  so  that  by  Theorem  14.3 

5+0  xe A ( £ )  x 

of  [1],  A ( £ )  is  conditionally  compact  in  0(0,1]. 

Thus,  co(A (e))  is  conditionally  compact  in  D[0,1].  Now, 

P (X  i  CO (A ( £ ) ) ]  s  P (X  i  A(E)]  »  P[xn  €  u  A°(e)]  S  l  P [X  e  A? (e) ] 
n  n  n  K  n  K 


=  l  P(X  i  A.  (e)  ]  s  l  sup  P(X  t  A.  (£)]  <  l  t.  »  £,  by  (**)  . 
knK  k  n  n  x  x 

Since  £  was  arbitrary,  (Xn)  is  convex  tight,  Q.E.D. 

LEMMA  6.4:  If  (Xn)  is  convex  tight  and  uniformly  integrable, 

then  (X  )  satisfies  (CT) . 

n 


PROOF:  Given  e  >  0,  find  by  uniform  integrability  5  such  that 
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E  11Xn  IlXn^B(6)]11  <  e'  for  each  n. 

By  convex  tightness,  find  K,  compact  and  convex,  such  that 


P[Xn^K]  <  j,  for  every  n. 


Then 


E  "Xn  I[X  ^K]  "  =  E  HXn  I[X  ^K;  X  ^B  (d)  ]  H 


n  n 


+  E  HXn  1  [X  «K;  Xw  c  B (6)  J  H 


n  n 


<  e  +  6  E  I 


[X  *K;  X  <B (6) ] 
n  n 


&  e  +  5  E  I 


<VKI 


-  €  *  6  P[Xn<K]  <  E  +  £ 


Thus  (X  )  satisfies  (CT) . 
n 


Q  •  E  •  D . 


However,  by  Example  6.3  below,  uniform  integrability  cannot 
be  replaced  by  stochastic  boundedness  in  Lemma  6.4. 

LEMMA  6.5:  If  (Xn)  is  tight  and  uniformly  integrable,  then 

(X  )  satisfies  (T) . 
n 

PROOF:  Exactly  the  same  as  that  of  Lemma  6.4. 

LEMMA  6.6:  Uniform  integrability  implies  stochastic  boundedness. 

PROOF:  Let  B(5)  -  {x:  ||  x||  i  6}  Let  e  >  0  be  given  and 
choose,  by  (UI) ,  6  such  that  E  ||Xn  Ijx  *  c»  for  ®ach  n. 
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Then,  for  6  2  1,  for  every  n, 

Pt  llxjl  X  si  -  PI  II Xn  I  ,11  *  si 

n 

5  I  EI  HXn  1IXn^B(6)  ]  II  ] 


*  E  II Xn  1  lXn^B(  5)  ]  ll  s  e#  Q.E.D. 

THEOREM  6.7:  If  (Xn)  is  uniformly  integrable,  then  the 

following  are  equivalent: 

1°  (Xn)  is  convex  tight; 

2°  (X  )  satisfies  (CT) ; 
n 

3°  (Xn)  satisfies  (MT) . 

PROOF:  1°  =■*  2°  follows  from  Lemma  6.4;  2°  -*■  3°  from 
Lemma  6.2;  3°  *=>  1°  from  Lemma  6.6  and  Lemma  6.3.  Q.E.D. 


LEMMA  6.8:  If  (X  )  satisfies  (CT)  then  (X  )  is  convex  tight. 

n  n 

PROOF:  Lemma  6.1  yields:  (CT)  implies  stochastic  boundedness. 
Now  Lemma  6.2  and  Lemma  6.3  yield  the  result,  Q.E.D 


6.3  Easy  examples  show  that  (MT)  does  not  imply  tightness  nor 
does  tightness  imply  (MT) . 

We  write  (UI)  for  uniform  integrability  and  (SB)  for  stochastic 
boundedness . 


EXAMPLE  6.1:  (01)  does  not  imply  tightness.  The  counter¬ 

example  is  the  sequence  (XR)  of  deterministic  random  functions 

X_  ■  I  „  .  _  ,  n  ■  1,2, etc. 

n  2"nJ 
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Thus,  by  Lemma  6.6,  (SB)  does  not  imply  tightness  either. 


EXAMPLE  6.2:  (SB) 


(UI) .  Let  (Xn)  be  the  sequence  of 


random  functions  defined  by 


xn(t) 


!n,  wi 
0,  wi 


with  probability  i. 


with  probability  1-  — ,  for  Ostsl. 


EXAMPLE  6.3:  Convex  tightness  and  (SB)  do  not  imply  (MT) . 
Let  Xn  »  X  for  every  n,  where  X  is  defined  as  follows.  Let 


x  *  22n  I  .  . 

n  r  1  1 

2n'  2n*1 


,-n 


,  n  =  2,3,...,  x.  =  4  I  . 

)  1  if,  1) 


Let 


P[X  *  xnJ  =  2  , 


n  »  1,2, etc.  Then  X  is  convex  tight  and  stochas¬ 
tically  bounded.  But  for  any  partition  P  of  [0,1], 


E  { 


max  sup  |x(t)  -  X(t.  ,)l>  *  El  sup  lx(t)  -  X(0)(] 
i»l,...,n  t<l.  0st<tx 

CD 

■  E[  sup  ( X  ( t)  |  ]  ■  )>  2_n.  22n  ■  +  • 


0st<t, 


n»n. 


1  - 0 

Q .  E .  D . 

Thus,  by  Lemma  6.2,  convex  tightness  and  (SB)  do  not  imply  (CT) 


"V1 

where  nQ  is  such  that  2  <  tl*  Thus  (MT)  fails. 


6.4  We  have  (CT)  *>  (MT)  **>  (mT)  (RR)  .  The  first  impli¬ 

cation  follows  from  Lemma  6.2  and  the  last  two  are  obvious. 


EXAMPLE  6.4:  (mT)  (mt) .  Define  a  random  function  X  as 
follows.  Let  R  ■  10,1]  with  Lebesgue  measure.  Let  X(w)  ■  I ^ j . 

Let  e  >  0  be  given  and  choose  a  partition  P  of  (0,1]  such  that 

max  It.  -  t .  . >  <  e .  Then 
i-l,...,m  1  w 
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■f 


E  l  sup  | X ( t)  -  X(t.  ,)|]  =  t.  -  t.  .  <  £, 
teli  1"i  1  1-1 

for  each  i,  so  that  (mT)  is  satisfied.  However, 

E[  max  sup  |X(t)  -  X(t.  .)|]  =  1, 
i=l , . . . ,m  t« I .  1-1 

i 

for  any  partition  P,  so  that  (MT)  fails.  Q.E.D. 

Since  tightness  implies  (SB),  by  Lemma  6.3,  (MT)  and  tight¬ 
ness  imply  convex  tightness.  That  (mT)  and  tightness  do  not  imply 
convex  tightness  is  shown  by  Example  6.4. 

EXAMPLE  6.5:  (T)  (MT)  .  Let  X  be  the  random  function 

of  Example  6.4.  (MT)  fails.  Let 

Ke  =  {x  =  :  0  <  |  s  a  s  1  -  |  <  1} 

where  0  <  e  <  1.  Then  K£  is  conditionally  compact  in  D,  and 

E  1 1 X  1  [x^K]  II  =  f  +  f  =  e*  Since  e  is  arbitrary,  (T)  is  satisfied. 

Q.E.D. 

Clearly,  also  (MT)  =jk>  (T)  ,  so  that  no  implication  holds 
between  the  two  conditions. 

LEMMA  6.9:  For  a  random  function  X  in  D  with  E  ||x||  <»  , 
condition  (mT)  is  satisfied. 

PROOF:  For  0  s  a  <  0  s  1,  let  p(a,B)  «*  E[  svp  |x(t)  -  X(s)  |). 

ast,s<8 

Let  *2  "  1  if  p(0,l)  i  e :  otherwise, let  »  inf{t:  p(0,t)  >  e}. 

Since  lim  p(0,^)  *  lim  E(  sup  .  |x(t)  -  X(s)|] 

n-*»  n  n-*-«  Oss,t<- 

n 

■i 
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=  E [lim  sup  ,  |X(t)  -  X(s)|]  =  0, 

n-*»  0st,s<— 
n 

by  the  dominated  convergence  theorem,  using  E  ||x||  <  »,  we  have 

t  1  >  0. 

In  general,  let  x^  =  1  if  p(Tj_^,l)  s  e,  and  let 
Tj  =  inf{t:  t  >  and  P(Tj_j_»t)  >  e  )#  otherwise  .  Again 

Tj  <  Tj+1* 

Now  suppose  that  x^  <  1,  for  every  j  =  1,2,...  .  Since 
(xn)  is  monotonically  increasing  it  converges  to  some  t^  e(0,l], 
and  since  X  e  O, 


lim  sup  |x(s)  -  X(t)|  =  |x(t  )  -  X(tQ)|  =  0. 

n-  Tn^t,s<xn+1 


Thus,  e  <  lim  E[  sup  | X < t)  -  X(s)|]  *  0,  a  contradiction. 

tnrt,.<Tn+1 

This  proves  the  lemma.  Q.E.D. 


EXAMPLE  6.6:  (RR)  and  (M)  ¥>  tightness.  Let 


xin  "  1 f 2i~l ,  2i  '  1  "  i'2'---*2"  l~  1 
2n  2n 


2n"1'n  [^T'  1] 

2n 


Define  the  random  function  X  by 

n 


PtXn  "  xin]  “  ^n^T  '  for  1  " 


n-1 


We  show  that  (m3)  is  satisfied.  Let  P  be  a  partition  and 
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let  1 1 P 1 1  be  its  norm. 

Given  an  interval  £ 1  of  P,  for 
at  most  [2n  ||p  ||  ]  +  1  values  of  j  such  that 
x.  is  ■  1  has  a  non-empty  intersection  with 
the  greatest  integer  function).  Thus, 


fixed  n  there  can  be 
the  interval  where 
[t.  ,  t. ].  ([•]  is 

X~  X  f  X 


P{u) : 


sup  |  X  (t )  -  X  ( t .  ,)|  =  1}  *  ( [2n  ||P  H  ]  +  1)~ 
v .  n  ii  I*!  o*1 


ti-ist<ti 


£  (2n  || P  ||  +  1)^  =  11*11  +  %,  and  so 


E[  sqp  |xn(t)  -x^lt^)]]  ■  p{  sup  |xn(t)  -xn(ti_1)|  «  1) 


Vlst<ti 


Vl^i 


1  n-1 

£  ||  p  ||  +  —  ,  and  this  holds  for  each  i  =  1,...,2 

2n 

Let  e  >  0  be  given.  Choose  ||p||  <  §•  and  n  such  that 


i—  <  |  .  Then 
2n°  2 


sup  max  E[  sup  jx  (t)  “  X  ( t.  )  |  ]  £  e, 

n-n0,nfl*l,...  i 


Now  refine  P  so  that  this  holds  for  n*l, . . . ,ng-l.  Also 


sup  max  E[  sup  ) X  ( t)  -  X  (t.  .)|]  s:  e. 
n  i  fci_ist<ti 


But  this  is  (mT) . 

But  the  sequence  (Xn)  is  obviously  not  tight;  this  can  be 
seen  by  Theorem  15.2  of  Billingsley;  in  fact 


&*’.*w**WnKi***t*,  v 


lim  P  [w  (<5)  >  e]  =  1, 
n+®  An 

if  0  <  e  <  1,  for  any  6  >  0. 

Since  (X^)  satisfies  (mT)  but  is  not  tight,  it  satisfies 
(RR)  and  is  not  tight.  (M)  holds  since  every  Xn  is  bounded  by  one, 


Q.E.D. 


LEMMA  6.10:  If  (Xn)  satisfies  (RR)  and  (T) ,  then  it 


satisfies  (mT) . 


PROOF:  Let  e  >  0  be  given,  and  by  (T) ,  choose  K,  compact, 

such  that  E  l|XnIjx  ^k]  II  <  e'  for  a11  n'  and  let  p  be  a  partition  of 

n 

[0,1]  such  that  (RR)  holds.  Choose  6  >  0  such  that 
0£s£t<n<s+Ssl  implies 

|x(t)  -  x(s) |  s  |x(u-0)  -  x (s) |  +  e,  for  all  x  e  K. 

By  adding  points  to  P  if  necessary,  arrange  for  nax  {t.  -  t.  .. }  <  6. 

i=l,...,m  1  1"A 


Write  Xn  ~  Xn*  [X_eK]  and  Xn  "  Xn*  [X  ifK]  *  Then' 


max  E [  sup  |x  (t)  -  X  (t.  .  )|] 
m  n  n  i-l  1 

i=i#  •  •  •  fin  tc 


s  max  E [  sup  | X  ( t)  -  X  (t.  .)|) 

i=l, . . . ,m  tel.  n  n  1’1 

i 

+  max  E[  sup  1 X  ( t)  -  X  (t. )|] 

i=l, . . . ,m  teli  n  n  l 

s  max  EflVVO)  -  VVl*  +  e  +  2E  |)xj| 

i*l, • • •  ,m 


s  max  sap  E[|X  (t)  -  X  (t.  .) |]  +  e  +  2e 
i=l, . . .  ,m  teli  n  n 

<e+e+2e=4£#  and  thus  (mT)  is  satisfied. 

6.4  We  have  the  following  diagram: 

(M)  r>i  **  (m)  -*'(SB) 

JJ.  t 

(M)  <=  (T)  «->  (CT)  =*s>  (MT)  =■*>  (mT)  =*>  (RR) 

4 


convex 

tight 


2 


Does  (RR)  inply  (irtT)  ? 

Does  (RR)  together  with  (M)  inply  (nff)  ? 
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